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latroduetlon 

The  necessity  for  realiaing  the  optima,!  process  on 
any  given  criterion  in  an  automatic  conti*oi  system  with 
limited  control  functions  (actuating  signals)  has  lead  to 
the  examination  of  a  certain  problem  in  the  calculus  of 
variations.  Such  a  problem  in  general  cannot  be  solved  by 
means  ot  the  well-known  Euler  equations  since  th©  control 
function  varise  only  within  a  bounded  and  closed  domain. 

The  present  paper  contains  a  proof  of  L,S,  Pontryagla 
Maximum  Principle  for  linear  control  systems  which  is  used 
as  a  basis  in  doterialniag  th©  optimal  control  function  when 
it  is  limited  by  a  closed  domain. 

For  the  sake  of  simplicity,  the  article  will  deal 
only  with  optimum-rate  systems;  in  general,  however,  the 
Maximum  Priaelpie  Is  equally  applicable  to  other  criteria 
in  the  form  of  an  integral  of  functions  of  the  system  co¬ 
ordinates  and  controlling  functions, 

I,  Statement  of  the  Problem 

We  now  proceed  to  state  precisely  the  problem  of 
optimal  control  with  linear  controlling  function.  In  this 
case,  the  Maximum  Principle  is  proved  with  the  aid  of  classl 
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cal  Infinitesimal  variations  of  the  control  funetione. 

Thus »  lot  there  be  a  differential  equation  of  order  n 
which  describes  the  transient  process  in  a  given  automatic 
control  system: 

3j<n)  ~  -f-  uCt).  (1) 

Introducing  the  notation 


X  ~ »  X  * 


3,2  v<n-I) 


it  is  possible  to  rewrite  equation  (I)  a.a  a  a 
order  differential  equations: 

e  *2. 

■  42  Jg  3*3. 


•  n-1.  .. 


x“  "  f Cx^,x^-,,,,,x“)  +  uCt) 


ystem  of  n-th 


(2) 


* 


where  aCt)  is  a  scalar  control  vector. 

Let  us  assume  that  u  *  u(t>  is  a  piecewise  continuous 
function  of  time  tiiu<t>|^l  for  any  instant  of  time  t.  The 
last  statement  Is  a  condition  constraining  the  control  £unc~ 
tlo<n  to  lie  within  the  limits  of  variation  of  u.  The  control 
u  =*  uCt)  with  such  properties  will  be  termed  a  permissible 
control. 

For  the  setke  of  brevity  and  symmetry  la  notation, 
let  us  replace  system  (2)  by  a  mor;.  general  system  of  n~th 
order  differential  equations 

x^  =  f ^(x^.x^, . . . ,x“)  +  b*u<t), 

where  1  -  l,2,,,,,ni  b''.are  all  constant » numbers . 

Let  us  also  write  down  system  C3>  In  veet.Orlal 

X  a  f (x)  +  bu,  (4) 

1  2 

where  x  »  (x^,x  ,,,,,x”),  x  =  <x^, , , « tX*') ,  b  =  <b^,,,,,b“). 

The  optimal  control  problem  can  be  formulated  In  the 
following  manner: 

let  US  consider  two  points  jf^and  in  the  phase  apace 


<3> 

fora: 
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X  ot  Bjstsu  (3)  it  is  requx!^0d  to  cieta'nalne 

a  permissible  control  u  =  uCt)  sxtch  that  th©  describings 
point  x(x^,.,*,x“)  of  the  system  <3)  will  move  from  the 
Initial  point  Yo  final  point  in  the  shortest  time. 

Without  placing  any  restriction  on  the  generality 
of  the  problem,  it  is  possible  to  assume  that  the  system 
was  at  point  (3p  at  time  t  =  0,  reaching  point  Yi  ®-t  time 
t  ~  T,  where  T  is  the  duration  of  the  optimal  process, 

2,  Basic  Relations 

It  must  be  noted  that  the  Maximum  Principle  is 
merely  a  necessary  condition  for  the  existence  of  ati  opti¬ 
mal  process.  Let  us  assume  that  there  exists  an  optimal 
control  "u  =  u(t)  and  a  corresponding  opti’.aal  locus  ^  =  x(t) 
for  O^t'^T  obtained  from  system  (3)  for  a  “  uCt)  and  con¬ 
necting  points  "^jjand  with  an  optimal  transition  time 
equal  to  T,  Then  this  control  u  ==  u(t>  and  the  corresponding 
locus  X  =  xCt)  =  [  x^(t  )  ,  ,  ,  ,  ,x’'^{t  )1  satisfy  system  (3)  for 
0^1<T,  l,e,, 

x^  =  f  i  (x^  ,  ,  , ,  +  b^S(t>,  i  “  1,2,,, «,n; 

x<0)  =Yo  ,  x(T)  =  (S) 

Let  us  denote  by  Su  =  S^u(t)  the  various  permissible 
variations  of  the  optimal  control  "u  -"uCt),  i,©,,  u  +  5u(t) 
is  a  piecewise  continuous  function  of  time  t  and  \  u<t)  +  Oa(t^ 
^1  for  0  Further,  let  us  denote  by  §x  =  i'x(t)  the 

variations  of  the  optimal  locus  x  =  x<t)  corresponding  to 
the  variations  5u  =  5u(t)  of  the  optimal  control  u  «  uCt)} 

moreover,  ^x(O)  =  0  and  Sx(T>  =  0,  since  the  variKtlor.al 
loci  must  pass  through  the  points  Tgand  if 3^  lying  on  the  opti¬ 
mal  locus.  r  — .  r' 

Let  us  now  set  u  ”  u{t)  =  u(t)  +  5^u<t)  =  u  +  ou  and 
X  =  x(t)  =  x(t)  +5'x(t)  =  "x  +  ox  and  make  the  substitutions 
into  system  (3), 

Separating  from  the  right  side  of  each  equation  in 
system  (3)  the  first-degree  terms  in  -  Sxj^(t)  and  making 

use  of  equations  (S),  we  obtain 


i— l,,,,fn,  CdJ 
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Systftn  <6)  is  a  eo*«called  equatlca  la  terras  of  variations; 
teriise  of  order  higher  than  one  ere  designated  by  three  dota. 

System  C6)  can  be  briefly  written  in  the  vector-mat¬ 
rix  form 


^  A  ^  X  +,,,t  b^u 


where  A 


j^^ljla  an  n-th  order  square  matrix. 


Examining  first  the  system  of  equations  of  the.  first 
approximation  obtained  from  equations  (6)  and  (7>  by  neglect¬ 
ing  higher-order  terms  in  we  haves 

i  “  (B) 

It  is  possible  to  prove  that  is  the  first  approxi¬ 
mation  toS*^,  l.e,, 


(t )  -  d  xCt  j 
- .  . 0 


0  for  l^uCt)!  =Y^"^0, 


la  vector-matrix  form,  system  <8>  aasumes  the  form 

|aA-|+bru{ 

1=  1=  . 5°J.  A 

Next,  let  us  denote  by  OCtj^),  O^^tA-^T,  the  set  of 
points  of  the  form  xCtj)  +  these  are  the  same  points 

which  may  be  reached  at  time  tj^  moving  with  the  aid  of  an 
arbitrary  but  permissible  control  «(t>  =  Kt)  +  Suit)  in 
accordance  with  equations  (8)  and  <0)  with  initial  conditions 
We  shall  prove  that  for  <»,ny  O^tj^-^T,  the  domain  G<tt) 

is  a  convex  set,  Leti  us  take  two  arbitrary  points  .belonging 
to  domain  0.(ti), 

x^Ctj.)  «  xCtj^)  1- 

obtained  from  the  permissible  controls  "utt)  +Su,(t>  and 
u<t)  t  0=^t=Sti^. 
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Lst  us  sho’af  that  point  +  |ASg(t) 

for"*\?=-0,U  >-0,\+^  «  1,  lying  ea  the  segment  Joining 
points  xiCt^)  a»d  X2Ctj^)  is  also  included  la  domain 
i«.e*t  that  x^,(tj^)  belongs  to  6<t|^>*  iUid  we  actually  obtain 
t  ha.t 


X^<tj  )  K  + 

»  xCtj.)  +  t 

It  Is  hence  apparent  that  the  point  XoCtj^l  is  ob* 
talned  with  the  aid  of  the  control,  liCt)  +  ttyCt)  +|/'yu2Ct), 
0/\Vt^tj.,  It  remains  to  show  that  this  equation  is  peraissible* 
We  have  that 

1*0  +  A-^  Uj  + 

^  |7^(u  +  S'uj^)!  +  (n  +  ■¥  jA  «  X* 

since  |u  +  ^Uj^{  "^l  and  |tt  +  ^02)  1» 

It  fellows  from  this  that  belongs  to 

i*e.,  domain  OCt^,)  inoludes ,  along  with  some  two  points, 
the  entire  segment  connecting  these  points;  this  means  that 
GCtj^)  is  a  convex  set. 

Let  us  show  now  that  the  point  "xCtj.)  of  the  optimal 
locus  for  lies  exactly  on  the  boundary  of  the  oon^ 

vex  domain  Q<t^)*  And  actually,  the  point  xCt^^)  cannot  lie 
on  the  exterior  of  the  domain  GCt^)  by  virtue  of  the  defi¬ 
nition  of  this  domain  (see  page  4/. 

It  remains  for  us  to  prove  that  the  point  can¬ 

not  lie  strictly  on  the  Interior  ©f  domain  0(tj^)*  The  assump¬ 
tion  that  the  point  x<t^)  .lies  strictly  within  the  domain 
a<tj^)  leads,  as  Is  proved,  to  a  eontradlction  of  the  f&et 
which  we  assumed  at  thw  very  outset,  that  the  locus  x  asTtCi), 

0 ■i&T  is  optimal,  since  it  is  then  possible  to  reach  point 
x(tj^>  in  a  time  shorter  than 

Since  the  set  Qft)  , 0 is  convex,  it  is  possible 
to  draw  a,  support  hyperplane  through  pvlni  xCt) ,  0  •St  «.-T, 
such  that  Q(t)  will  lie  on  one  side  of  P.  At  point  ?  let 
us  tahe  the  vector t 

pCt)  =  <p^(t),  p^Ct),,,, ,p®(t)> , 
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orthogaiial  to  plane  P  and  directed  eiit  of  domain  oCt). 

Since  the  vector  ^(t)  likewise  directed  out  of 
point  s(t)  and  has  ito  end  point  in  GCt5»  as  a  result  of  the 
convexity  of  G(t>,  wo  olbtaln  the  scalar  product 

p(t)*  Ct)  <^=^0  fojr  0 

where  the  vector  ^(t)  ®  ^  (t)  Is  ji  8olu~ 

tlon  of  the  systeta  (0)  fdr  any  permissible  control  \i  +  du. 

The  general  solution  of  the  non-homogeneous  system 
otf  linear  equations  <9)  with  the  initial  conditions  |i(0)=0, 
1  a  l,«*.,n  has  the  fora 

a.  .  ‘‘v 

«*<t>  %  cr)b^dtt(r)dr"  cii) 

>  =tn'  •  0 


where 


y/ubjtv 

f  <t>  «  If®<t)),  J  =  1.2,.., 

^  ’a  s  ^ 

is  a  fundamental  system  of  solutions  to  the  homogeneous 
linear  system  corresponding  to  system  C0>,  and  (t>j|  is 

the  inverse  of  matrix  |)\|)^<t>^^  . 


As  a  result  of . the  neceaeary  condition  <10)  for  the 
optimal  solution  and  equation  (11),  we  obtains 

p(t>'|.<t>  «  ^  a 

St  tl  ’  . 


isl  <n  “  t 


S  S'u<'l?>dr  =  j4>Cr)bJu(^)d'^4o 

0  0 

where  '^(t)  *  ♦ « .  .'j^ijCt))  .  ^Pj^>  CX*)  •• 


<h2) 


=  .^  cc), 

X  \  Cl  "•  i 


H«nc»,  the  optimiam  solutioa  requires  that  tha  fol- 
lovlng  condition  bo  aatisfieds 

,  t  , 

(  vf(y)b  ^'u(r)d3“  ^  0. 

‘0 

From  Inequality  (13)  it  follows  that  the  optimuB 

control 


uCt)  “  sign^(t)b,  O^ti^:!**  (14) 


Actually,  since  the  function  sign  %  la  &  piecewise  oontSau- 
ous  function  of  its  argument  and  does  not  es:e0*d  unity  in 
modular  value,  the  control  (14)  is  indeed  permlsaiblo.  Now 
let  us  consider  the  opposite  ease»  1*®«,  that  iy(t)fo>0 
and  «(t>‘^  1  for  0  2=t  In  this  ease  ws  assume 


fdi  «  const  ^0  for  (t'jb  ^lo, 
u(t)  “  ^ 

lo  in  all  other  eases, 

Then,  as  a  consequence  of  equation  (13),  w©  have  that 

^  (t)b  ^ tt(3‘>dT'  -  iv  (t)bo<<rvS  >0, 


I’hu.s,  wo  obtain  a.  oontTadiction  with  the  aid  of  condition 
(13) I  hence  we  conclude  that  for  'p(t)b>0,  tt(t)  =  1  in  all 
eases. 

la  a  completely  analogous  mamer,  it  is  pSsslbl.e  to 
show  that  for  i|?Ct)b-^£io  w©  obtain  u  «  -1«  Consequently, 
equation  (14)  has  been  proved* 


3.  The  Determining  System  of  aifJtar.estlaA 
B«uatto.n3  -lor-  Vector-  <p..Ct.) 


lot  us  derive  the  differential  equations  which  de¬ 
termine  the  vector  "^(t)  =  CJ^^(t),  'V^Ct),*,*,  04t-4,T* 

AS  a  result  of  the  fact  t hat and  (t)||  are 

mutually  inverse  matrices,  we  have  that 


<t)4^  <t)  «  d 


for  1  »  J 


obtain 


Differentiating  this  equation  with  respect  to  t,  we 

i4Ct)^''^(t>  +  =  0.  <15) 

Since  satisfies  the  equation  -  As^iCt)*  expression 

(13)  may  be  rewritten  as 

^  »  0, 

+  (f"J>  =  0, 

where  A*  Is  the  conjugate  of  litatrlx  A, 

The  last  equation  is  satisfied  for  any  i  « 
andvD»»t^  *♦••»*-(  are  linearly  independent  vectors  for  any 
as  a  fundamental  system  of  eolutions.  Thus,  we  ob¬ 
tain  that 

‘jlj  ss  -A*^^j  J  =  l,2,a««in*  <16) 


Since  the  vector  'ftfi  Is  a  linear  coiabination  Of  vector* 

^  (t),  J  **  l»2,,»,n,  \p(t)  will  also  satisfy  equation  (16), 


1  «  f 


'^(t)  ~  -A* 


<t) 


<17) 


Further,  let  us  write  down  the  equation  (^Ct)  for  the 
ease  of  the  initial  system  (2)j 


^  “  -t’’  • 

Ox 


(18) 


.P-  = 


•x 


^  ^  ~r  ~  •>.  n  t  • 


As  a  result  of  expression  (14),  the  optimal  control 
in  this  case  will  be  u  «  sign  ,  since  it  is  necetriary 

to  set  b  «  (0,0, , , , ,0,1),  Let  us  now  show  that  the  expression 
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g  0  &n  any  interval  (t^,  0,T,]  If  I*  0. 

Lot  US  Mako  t ho  contrary  asosnraption  that  for 
f6Ct2^»t^)Cl  lOtTlv^  (t)  0.  Then  as  a  result  of  the  last 

sQuatlon^'of  (IS),  we  obtain  that 

'Vn-1*  s 

From  the  socond-to—lest  equation  of  system  (ISj  we 
obtain  that 


'^a-a. 


» 


Ih  on  ( t  If  1 2  , 


since  it  has  already  been  proved  that  ii 

up  to  the  first  equation  of  system  (1®>, 

Thus,  we  have  that 

fj^ct)  »  fjjtt)  5  ....  5  fn<t)  S.  0  on  <ti,t^)C[o,T]. 

But  this  solution  is  obtained  only  in  th®  cause  'pCO) 

=0,  due  to  the  uBlqueneSS  of  the  solution.  «e  now  have  a 
contradiction  to  the  statement  that  t^C)  0.  This  proves 
that  the  control  u(t)  *=  sign  ijt>jj<t )  ie  determined  almost 
throughout  ^jT]* 

On  the  basis  of  these  results,  it  is  possible  to 
formulate  the  optimum  condition  in  the  form  of  L.S*  Pont- 
tryagin*s  Maximum  Prineiple. 

Let  us  consider  the  scalar  product 

n 

i,i^<t)x<t)  ^  ^  Wtykfit}, 

(A  *  I 

whihh  on  the.  basis  of  system  <3)  is  equal  to 
f(t)xCt)  =  ^ (t>f,iCx(t)>  +  ^<(t>b1k(t)J. 


For  fixed  vectors  x<t)  and  vpCt)  and  a  varying  parameter  uCt) 
within  the  limited  range  /u(t)|  ^1,  the  last  expression  (16) 
reaches  a  maximum  according  to  equation  (14). 
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The  Maximum  Prlnoinle.  In  ord&v  for  u(t)  to  be;  as 
optimal  control f  it  Is  nocossary  that  tha  function 

‘  n .  ^ 

E(3,s^'j^,u)  ss  vf'<t)i<t)  =  (t)f^  (x<t))  +  U4<t)b%Cti} 

reach  a  maxliaua  along  u(t>  ah  this  piecewise  continuous 
function  varies  within  the  interval  [-l,lj.  The  2n-dlmeneional 
ixtf)  vector,  moreover,  is  the  solution  tc  the  following 
Hamiltonian  system: 


=  .lit .  . 

^  tt  -  ^  ^  , 

d 


For  the  sajse  of  illttstratlon,  let  us  examine  tho 
derivation  of  an  optimal  control  for  the  simplest  second- 
order  linear  system.  The  control  uCt),  limited  in  Its  modu¬ 
lus  to  |u<t)|  ^  I,  is  fed  liito  the  input  of  an  aperiodic 
component  with  time  constant  T  and  gain  kg.  The  signals 
at  the  output  of  the  aperiodic  component  Xg  are  fed  to  the  ■ 
input  of  an  integrator  of  gain  kj^  and  output  The  equations 
deacrlhing  such  a  dynamic  system  will  have  the^fom 


kgxgs 

T5„  =  -  x^  + 


Substituting  In 


can  be  rewritten 


■2  “  "  ^ 


■  ■  \  X  s  a  e  i. 
^  2  ^ 


St  5S  w  < 
1  2* 


k  u, 


<20) 


Xg,  equations  <20) 


~  Kg  +  u,  iu(t>14l. 


(21) 


Matrices  A  and  A*  in  this  case  have  the  form 


.  0  -  i. 


f  AV  e 


10 


consequently. 


for  the  systeia  takes  the  forsi: 


'fCt)  «  0} 


f,<t> 


+ 


(22) 


(as) 


Vt 

Further,  we  find  that  =  De  ^ +  Dj^,  where  3B 

and  02  nrhitrary  constants.  j^u 

Thus,  the  optlnal  control  Is  of  the  fora  uCt)  «  sign 
the  constants  0  and  0^^  being  deteraised  by  the  condition 
that  the  locus  xCt)  reach  the  required  point  at  the  aoment 
of  process  teralnaticn, 

It  is  evident  that  the  function  «  0e  changes 

sign  not  more  than  once  —  i*d*,  the  optimal  process  must 
consist  of  two  time  intervals,  in  each  of  which  u<t)  takes 
one  of  its  limiting  values. 
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